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ABSTRACT \ 

This paper describes the assessment procedures that 
were employed by stil^nts and instructor's in an advanced graduate 
course for eduo^tionM. administrators. Because the coarse objectives. < 
were a combination of^ognitive objectives^ performance objectives^ 
and affective 6b jectivei^^^if f ereiit f orms of assessment were chosen 
fbt each specific typie or^objective. "Enabling or discrete objectives 
were assessed informally first through checks with peer perceptibnsf 
and faculty perceptions. Experiences that were to serve as 
prerequisites for the achievement of later objectives were assessed 
through a record of participation. Terminal^ complex cognitive 
objectives wexe assessed through written exercises. Obj'ectiyes that 
^resulted in written reports of research efforts werQ assessed by the 
outside agencies for which they were^done. Final assessment of the 
growth of the total group and of individual students was accomplished 
thfough public statements of ^self-evaluaticf'n checked by peer 
perception. (Author/JG) 
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We in New York State are faced with the State Education 
Department mandated re-registrafcion of all preparation programs 
for educational administrators in January of 1976. The 
re-registration process has two important dimensions; the 
restatement of program in specific competence-based format 
and the formation ^f a tripartite consortium to "restate the 
program and to monitor the certification prdcess. 

The restatement dimension is rather straightforward. 
Each program must contain at least the following elements: 

a. The program must be stated in terms of instructional 
objectives. 

b. The rational^e and procedures for program evaluation 
and renev;al must be explicit. 

c. The proccBdures and proces^ses for assessing 
students must be specified. • 

d. The procedures for counseling students; must be 
stated. . . 

The second dimonsioji is more complex. A tripajMdTte consortium 

made up of members from the university , the school districts, . 

and the teacher association or union will deV(?lop the re-regis- 

tr-ation documents and monitor the implementation of tlie revised 

programs. The problems that ari'se out^f the consortium / 

activities are significant and worthy o.f careful examination, . 

however th^t examination is beyond thp scope of this paper. 

> Curafently, v;e *at the State University of New York at 

Alba^ny arfe attempting to state the objectsives of our program 

and are experimenting with various procedures and techniques 

for asscsi^ing students and for;, operating and evaluating a 

competence-based progrc^m. 
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We are faced yith tv;o major assessment dilemmas, that 
pf deciding what to assess and then how to assess without 
resorting to^the omnipresent laundry list format,," In this 
light then, it is the puiTpPse of this paper to describe a 
procedure for assessment the objectives in an advanced 
graduate course for educational administrators. The course 
is called Community Analysis and is part of a core sequence 
fo^ certificate and doctoral students. The course is taken 
during the residence year. The students have varied b%ck- 
grov^nds in terms of content and depth 'of preparation, and in 
ter^s of occupational aspirations, 

/ All features of a competcnckz^fer/sed program, particularly 
th<^ assessments, derive from the. careful ^statements of the 
oWjectives, The objectives of the Community Analysis course 

htO: father complex, TJje course is not purely cognitive, no4F 

/ * • • . ■ 

i/s it pu3jely performance, nor purely 'affective* Our first 

:ask was the establishment of course objectives. * These had 

:o be revised as we, the students and professors, came to . 

^know more ,about each other and as the course was more fully 

analyzed. Some of the objectives lent themselves to tra- 

ditional forms of assessment. In some cases, hov;ever, it 

was necessary to fi^rst explore with the class, what needed 

to bg assessed and then devise appropriatei means of assessment, 

Cognition lent itself to traditional means of fissessment. 

The course has a number of lower ord6r cognitive ob jectivess,^ 

* #• 

v;hich are easily assessed. For example, consider the first 

• < ■■■ . 



ERIC 



-3- 



objective as it was assessed in the take^-home final examin- 
ation, distributed on the first day of class which was duf 

, means of making the objectives and assessment of the course 

. . ^ 

explicit and public: i 

■ ' , . ^- , _ - .V ■ _ ■ • . 

1) In the literature of the social sciences, the 
community is defined in many way^. Identify 
' ' (author and title) and state five (5) definitions 

of community. (500 words). . \ ^ ' 

There were also some higher order cognitive objectives 

v/hich required the application of facts to a specific situa- 

tion. Agdin from the take-home exami^nation: 

.4V Discuss with reference to the literature, your 
role as an investigator in a field study. (500 
words) . 

' ' '^Implicit, in both o£ these objectives was that they were 
to be completed to the satisfaction of the instructors, subject 
to ntSgofciation with the student^ 

'\ There were objectives which related to skills training 

Which were, initially^ on a formative level assessed np^ in 

* terms of knowledge or performance but rather in terms of 

experience. The skills were taught in a laboi;<l(^ory situation 

and the assessment was simply a record of participation in 

the experience. A summative assessment of the skills was 

deferred until later ia the course when the students, were 

doing the field work. The objective as it appear.ed in print 

' • looked like this for one. set of skills; 

Upon completion of this training unit you will Ije able to 
^. ' - identify and use five (5) basic communication skills 

( , ' - determine the appropriate use of any of these skills 
^ in. specific situations.* 



cnir ' ""Traaptcd from the InstrucU.©Q^SupGrvj^ii0frTra.ining Program 
devolopod by Boy an et al, U.C^fc_§A*^ca Barbara, X973 



Buto the assessmeifct was through, attendance at this 'training 
session and self-assessment. This obviously was formative 
in nature. * 

' Once the cognitive. materials had been mastered, at 
least on the lov;er le^vels, and the skills^had been intro- 
duced, at least on an experiential levdtlf the group was 
ready for a ynv^jor ^performance objective. The objective was 
defined, made public and negotiated with, the ^class. In 
retrospec/t it can be stated that the objective was that: 

Thef Community Analysis class will conduct a 
^comparative study of decision^making in te/o 
ii(stitution5 using as an entre the perfo^ance 
of organizational development studies whicVi meet 
/the needs of the respective organizations. These 
studies widl reflect* the learnings ,bf the first 
part of the course. 

The ass^essment tff tjiis complex ob:icctive was accomplished 
in a series of activities related to' the various phases of 
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the field study. As the worlc at iHe separate institutions 
went through the phases of initial'^ contact , client pfroblem 
definition, negotiations for resources available to accomplish 
problem solution,' specifications of objectives of the 
organizational development consultancy, data tjathering, final 
report developjnent , and presentation of the report. There were 
constant discussions among students and between students and 
the professors over the way particular jobs were to be and 
were in fact done. Sometimes these discussions focused upon 
the performance of individuals and sometimes upon the progress 
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of tijiO class as ^ whole or oh" 4 team v/ithin the class. 
\ > Additional opportunities' developed 



•aftiter the reports of the organizational development studies * . 
have, been written. The assessftient took the form of study team 
di;5Cussion of whose name would aippear on the firva!' report^ 
the criteria for inclusion bein|g baaad upon contributions made, 

r 

At this point the two client- organizations received and ^ 
reviewe"^ the .final reports of the ;organizational development 
studies. They provided the class with. feedback regarding 
their satisfaction with the reporij:s# 

" Once the tv;o organil^tional studies wete completed and 

the results reported to the clients/ the class theh had .to > 

prepare. ^the comparative analysis . of de^6i^ion making in the two 

client organizations. To accomplish this a nqv; round of 

discussions/iregotiations took place. . As these discussions 

and the\(ork activities resulting frbm the discussions v;ent 

on, there were continual feedback sessions among individuals, 

between students, between student^and professors and betv/een 

the class as a .whole .and professors as to the progress of 

■ * ■ ■ 

the report and the contributions made by* individuals. 
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On tv;o occanions during this period a two hour period was 
spent by the class rcvicv/ing the professors* role in leading 
the class. On the second occasion a form V;as employed to make 
a record of individual perceptions wJiich mighty have been lost 
in the general discussion. As we have used the terms evalua- * 
tion and assessment, this was an evaluation of the' progress-of 
the course and not ai/ assessment of students. 

Finally ^ after the class, had as a whole produced three 

documents, the two studies of organizatio.nal development ^ J 

problems "and the comparative study of decision making, which 

were satisfactory to the class and to the professors, a final 

feedback session occurred. 

^ . ' c 

Prior to the final feedback session each student was 

asked to prepare a short statement outlining* their contribu-tion 

to the studies. It was to be organized around three areas. 

First, the individual's contribution in terms of scljolarship. 

Second, ^^^^e^individual ' s success in meeting obligations to the 

group, attending meetings, performing chores assigned by the 

group, volunteering for chores and so forth. And, thirdly, 

r " ■ .' 

the' individual 's mode of operation within the group. Thepe three 
categories were supplemented by guidelines as appended to this 
paper. The self evaluations were to include statements of what 
the individuals actually did in behavioral termj^ followed by the 
individual's judgement of the value of that contribution. 

On the day of-:the final evaluation the class was divided ' 
into two groups. The profesi^ors functioned as facilitators 



yc 



confining their activities' to time keeping and monitor ipg the 

discussion% to keep 'the topic in focus. The first activity v;as 

to have each person's ^elf assessment statement passed to the 

one person left. The person who now.;J|feld the self evaluation 
f» . 

had three nfinutes to read* it and append a written, signed 

commont either in support or- in modification of the self assess-^ 

* - . 

ment or on topics n^t covex;ed by the self assessment. The only 

restriction v/as that the comment had to refer to specific 

behavior in order to support any positive or^negative jxidgement. 

At the end of three minutes the papers were again passed to the 

* \ 

left and so forth until all had seen and commented upon each 

* " ^ ■• , 

self assessment. When the papers had returned "home the group 
had five minutes toWad anj3 prepare a summary, to.be delivered 
oially. It was suggested that the summary should include a 
brief statement of what the individuiMv^id, a selection* of 
positive comment and finally a s.tatement from^the individual as 
to what the individual feels should be improved" in terms of 
self growth. Following the individual's summary o^^his or her- 
own assessment' and the reaction to it, there was tbne for a few* 
ininutes of further discussion by the groufJ^or clarification, 

/ ' ♦ 

^ When cvQryone had had their sgly<Qr when the allotted five 
ininutes had .e>:-pired, the person immediately to the right of the 

•person whose assessment was being discusafeti was charged with 

* • 

paraplirasing what had taken place during the oral portion of 

the assessment. As stated above," the ins true tor. confined 

their participation to time keeping and 4<ceping the discussion 

' ■■ » 

on the subject and in ^behavior terms. 



The' results of these self assessments as tested against 
Hihe group were most interesting. In some cases contributions 
v;hich individuals made which had not come to the attention of 



the professors were revealed/ In some cases the group brought 
out the lack of contribution although the individual in- '^^^ 
•question had left a favorable impresKsion with the instructors. 
Generally, however, it was clear that^the- perceptions of the 
students and the professors were very close. The final assess- 
ment Would not haye been substantially different if had been 
made by either one of the instructors, or by the class. In one 
case a person's self assessment was much better than that with 
which the group or the professors would credit that "person. .In 

♦ 

several cas^s the individual's self assessment \>a,s less than 
that of the class or the professors. It v;as q^bundaritlv clear . 
that individuals made differing contributions to the class. 
They did diffle^ent things. Contributions v;hich were considered 
equally worthy v;ere very different in nature,* 

There were some students v;ho organized the group, .that iis 
•whd rjecruited people to accomplish tasks. There were. those who 
made external contracts forythe class. There v;ere those who 
planned the work of the group. There were thosa who wrbte^. 
There were those^v;ho researthed and there were tnp3e, the 
majority, 'who did combinations of these and other tasks but 
usually with an emphasis in one area.- ^ 

These forms of assessment, paper and pencil tests of lower 

r 

and higher ord'er cognition, attendance at initial experiences, 
' the production of a product to assess performance and self 
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aascGsmcnt as tested against the perceptions of the group * 

• " ■ . ^ 4^ ■ •■ ■ r 

gave the professors and the clas^ ^ groat deal of' conf idenc(p 



in their procedures. Within the usual ' dil>forences of opinio^i 

" * . ■ . . . . ^ . ' ^ — \ — • , 

as to specif iop the paper and pencil tests picked up the ^' 

degree to which iniJividuals had mactered the tJieoretical bd^e,^ 

Attendance at the laboratory sessions was as precise an assess- 

ment of the skills being taught as v;as possible at the t/imia.' 

This formative assessment was ftfllowed by assessment of more 

sXwnmative nature through continuous^, informal feedback sessions 

as the skills were applied. The product v/as assessed basically 

by external organizations. They, had a need and the produ|:t 

had to meet theif need. In a sense the prgahixational dpvelop-^ 

ment studies done for the outside organizations were als/b ^ ^ 

summative assessments of the applicatic^n of the cognitive . 

objectives of the earlier partes "of the program to a real situa- 

•tion. The self assessment as tested again$t the perccc/tions 

^ of others served to pick up and point out the CQmpetbi|»es 

about which there v/erc differences of opinion. 

^ oThese procedures fallowed assessment to focus onpaiceas of 
•importance and significance to theiprofessors and the students. 
Objectives which v;ere accomplished without difficulty were , 
informally self assessed. Such self assessment was checked 
bbth informally and in formal situations by pecj: qCnd pro- 
fessional perceptions. 1?ime was not 'spdnt going through an 

• • • 

atomisti-c laundry list of objectives. ^' 

■ .' ■ ' 

The following chart relates the type of olAjectivc to 
tl>c assessment ♦ * . • / * 



TYPE .-OF OBJECTIVE 



cognitive objectives 
. for students 



Introduction to skills' 
for students/ 



PorformaneQ objectives 
for students 



Complex of objectives 
which combined knowledge, 
skills and> attitudes and 
were cfori^clated to 
individual student needs. 



FpRM-OF ASSESSMENT 



Paper and pencil^ests 



Attpndanqe at 'a||i experience 



a) outside ^"eviev; of 
product ^ 

b) peer discussion (informal)" 

c) peer committee revdew 

d) student ^ professor 
* conferences 



Self evaluation tested against 



peer perception 



C ours e instriictional 
objccJ:ives 



a) professors in student 
, f ishbowl 



b) written evaluation 
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